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Networks of chaotic units with static couplings can synchronize to a common chaotic trajectory. 
The effect of dynamic adaptive couplings on the cooperative behavior of chaotic networks is inves- 
tigated. The couplings adjust to the activities of its two units by two competing mechanisms: An 
exponential decrease of the coupling strength is compensated by an increase due to de-synchronized 
activity. This mechanism prevents the network from reaching a steady state. Numerical simulations 
of a coupled map lattice show chaotic trajectories of de-synchronized units interrupted by pulses of 
mutually synchronized clusters. These pulses occur on all scales, sometimes extending to the entire 
network. Clusters of synchronized units can be triggered by a small group of synchronized units. 



I. INTRODUCTION 

Networks of interacting nonlinear units show interest- 
ing cooperative properties, for example synchronization, 
dynamic clusters and scale-free activity. Therefore, a 
lot of recent research has been invested in understand- 
ing the relation between microscopic mechanisms and 
macroscopic behavior in nonlinear networks [U [2] . These 
results are of fundamental interest in nonlinear dynamics 
with a wide range of applications from coupled lasers to 
neural networks. 

In particular, synchronization of irregular spiking in 
neural networks is considered to be important for pro- 
cessing information in the brain [3]-[6]. Obviously, the 
brain does not relax to a state of complete synchrony. 
In fact, the resting state of brain tissue exhibits activity 
on all sizes with a maximal range of response to external 
stimuli [7, 8 . Synchronization, criticality and irregular 
activity of a neural network are generated by adaptive 
and competing synapses. 

Networks of nonlinear units with adaptive couplings 
have been investigated before [9-17 . Simple models 
of excitable units with adaptive rewiring rules relax to 
a state of criticality [18-20 . Already linear networks 
with adaptive couplings, following a negative Hebbian 
rule, show unexpected cooperative behavior; many lin- 
ear modes are competing with each other [21]. If the 
Hebbian rule is limited by a global restriction, a neural 
network develops a modular structure with a scale-free 
distribution of coupling strengths [22] . 

Synchronization and irregular activity are not mutu- 
ally excluded. Networks of identical nonlinear units can 
synchronize to a common chaotic trajectory [2j |23l [23]. 
For networks with static couplings, the stability of chaos 
synchronization is related to the spectral properties of 
the underlying graph topology [231 12S] • Here we extend 
this work to networks with dynamic couplings. 

In this paper we introduce a simple model - a network 
of coupled maps - which shows synchronization, chaos 
and scale-free activity. These cooperative properties are 
generated by a local adaptation rule which is governed by 
two competing mechanisms: A slow component prevents 
complete synchronization and a fast one which increases 



correlation between interacting chaotic units. Chaos syn- 
chronization is an unstable solution of our model equa- 
tions. 

We introduce adaptive couplings which change accord- 
ing to the current degree of synchronization among the 
units and thus influence the stability of the synchroniza- 
tion manifold. If the two units connected by a cou- 
pling are synchronized, the coupling strength decreases, 
whereas for large de-synchronization the coupling be- 
comes enhanced. We find that the adaptive network is 
still chaotic. It shows pulses of chaos synchronization on 
all scales; the distributions of sizes and durations of the 
pulses heavy tailed. The strengths of the couplings are 
distributed around the critical value of the corresponding 
static network. 



II. MODEL 

For the sake of simplicity, initially we investigate com- 
pletely connected networks of iterated maps. Each unit 
is described by a variable x\ G [0, 1], i = 1,..,A^ which 
develops in discrete time steps t according to the equa- 
tion 

-; = fi-E|z^)/w-.)+E|z^/(<.). 

(1) 

where the couplings G [0, 1] are time dependent. In 
this contribution we use the skew tent map 

/(^) = |L ""J" (2) 

with a = I in order to model the chaotic behavior of the 
units, but we found analogous results for the logistic map 
[26 and the Bernoulli map [27 . 

The synchronization manifold x\ = St is a solution of 
equations ([T]), 

st = f{st-i). (3) 

Hence, St has a chaotic trajectory with the Lyapunov 
exponent A = | ln| + | ln| 0.673. 
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The stability of this synchronization manifold can be 
calculated using the master stability function and the 
eigenvalues of the coupling matrix [23] • For static cou- 
plings, el^ = e, the synchronization is stable if the cou- 
pling is large enough. One finds [24 



< e < 



1 



1 

N-l 



In the thermodynamic hmit, N — > oo, this becomes 
0.490 < e < 1.510 



(4) 



(5) 



with the relevant synchronization border Cc ^ 0.490. Yet, 
already for N = 100 the critical coupling is quite similar, 
namely Cc = 0.485. 

However, here we consider dynamic couplings. The 
network ([T]) has TV (TV — 1) couplings with time depen- 
dent strengths e]^ ; each coupling changes according to 
the activity of the two units which it connects. We con- 
sider two competing mechanisms: On the one hand, the 
coupling is slowly driven to zero. On the other hand, de- 
synchronized units increase the strength of their mutual 
coupling. The dynamics of the couplings is defined as 



(6) 



In order to keep the couplings bounded, we reset each 
to = 1 if it leaves the unit interval. In the synchro- 
nization manifold, where A*-^ = 0, the coupling decays 
to zero exponentially in time with the relaxation time 
r = — 1^ foi" M ^ 1- If the couplings are small 

enough, any perturbation of the synchronized trajectory 
drives the system apart from chaos synchronization. But 
then the second mechanism tries to increase the couplings 
again to enforce synchronization. 

The competition of these two effects leads to a complex 
cooperative behavior of the whole network. 



III. RESULTS 



A. Fully connected topology 



The magnitude of the de-synchronization, Aj-^, is 
shown in Fig. [l] for a single pair of units. The re- 
laxation time is very long, r = 10^. The units are always 
highly correlated with each other. But occasionally the 
coupling strength increases above its static critical value 
and pulses of synchronization appear. 

Below, we are interested in the fraction, F, of bonds 
which belong to synchronized pairs, in the structure of 
synchronized clusters, in the strength and duration of 
pulses, and in the distribution of couplings. All these 
quantities strongly fiuctuate with time; hence, we will nu- 
merically calculate their distributions. Throughout this 
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FIG. 1. (Color online) Time evolution of the desynchroniza- 



tion AJ^ 



xl between two units in a completely con- 



nected network consisting of 100 nodes, whose dynamics is 
determined by ([T]) and ([6| with r = "h^^o^ggg) ~ 10^ and 
(7 — 2.0. For the synchronization threshold set to Ac = 10~^, 
the regions with the shaded area under the curve indicate the 
local synchronization pulses between the two units. 



paper, we will present simulations for systems of size 
TV = 100. However, investigations of systems with up 
to 800 units did not show any deviating behavior. This 
is in accordance with the observation that the synchro- 
nization border, ec, for TV = 100 is already close to the 
thermodynamic limit (Eq. ([5|). 

For the simulations, the states of the units are initial- 
ized with random values drawn from the interval [0, 1). 
All couplings are initially set to e^j = Cji = 0.35 and 
Cii = (no self feedback), i.e. we are below the syn- 
chronization threshold for that topology (see Eq. (|5|). 
Afterwards, the systems are iterated for 10^ time steps 
to make sure that there is no more transient behavior. 

Let us define synchronization between two units i and 
j with a threshold value A*-^ < Ac- Of course, due to 
the finite range of the state variables, a choice of a too 
large Ac will cause pairs of units to be mistakenly clas- 
sified as synchronized. Naturally, in the limit Ac ^ 1 
this is the case for all pairs, even for purely randomly 
picked state variables. In this work, we set Ac = 10~^. 
For this choice of the threshold, Ac, two uniformly dis- 
tributed randomly chosen values of the variables will 
lead to false synchronization classification with probabil- 
ity 0.002%, only. However, the observed behavior is ro- 
bust under variation of this threshold. According results 
were found for Ac = 10~^. 

The upper part of Fig. [2] shows the units which are 
synchronized with unit x^. One sees that synchroniza- 
tion is a cooperative effect; many units contribute to the 
synchronization pulses. All of the 99 units which are 
synchronized to unit x^ are shown as dots. From time to 
time many units are synchronized to the first one, and 
occasionally even the entire system is synchronized. This 
is also shown in the lower part of Fig. [2j The fraction, F, 
of synchronized couplings shows strong irregular peaks. 
When the complete system is synchronized (F = 1), the 
pulse extends over a large time interval. Then, the av- 
erage value of the coupling strengths, also shown in Fig. 
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FIG. 2. (Color online) Simulations for a completely connected network oi N — 100 nodes. The evolution is determined by the 



10^ and cr 



dynamics ([T]) and ([6| with parameters 
upper part of the plot show the pulses of synchronization with its environment. Every line corresponds to one of the neighbors 
j of the chosen unit. If the units are synchronized, i.e. Al^ < Ac = 10~^, this is indicated with red in line j at time t. In the 
lower part, the blue curve displays the fraction Ft of all pairs in the network, which are synchronized at time t (left axis). The 
red dashed curve shows the coupling strength, averaged over all pairs in the network at each time step (right axis). For the 
time steps indictated by the vertical dashed lines, the distributions of the coupling strengths are displayed in Fig. [7| 
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FIG. 3. (Color online) Fraction Ft of all pairs in the network, 
which are synchronized at time t. Simulations for a com- 
pletely connected network of = 100 nodes. The evolution 
is determined by the dynamics ([T]) and ^ with parameters 
a = 2.0 and (a) r = -j^^ ^ 10^ (b) r = 
2xl0^and (c) r = - ^ 10\ 



[2j decreases until it falls below the critical coupling, ec, 
and the system de-synchronizes. The couplings increase 
fast and decay slowly in contrast to the fast rise and de- 
cay of chaos synchronization. In Fig. [sjthe fraction T{t) 
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FIG. 4. (Color online) Histograms for the occurrence of the 
heights of the global synchronization F for a recording time 
of 5 X 10^ time steps. Each time step t contributes with its Ft 
value to the frequency i.e. each histogram has 5 x 10^ entries. 
The bin width is 1%. Notice the double- logarithmic scale. 



of pairs which are synchronized is shown as a function 
of time for different relaxation times r. With increasing 
r the fraction of synchronized pairs increases and pulses 
of synchronization become more frequent. Moreover, the 
duration of the pulses increases. 

Pulses of chaos synchronization occur on all scales. 
The fraction of synchronized pairs ranges from a small 
number to complete synchronization of all nodes in the 
whole system. This is shown in Fig. |4] where the fre- 
quency of occurrence of the F- values is plotted as a func- 
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FIG. 5. (Color online) Simulations for a completely connected 
network oi N — 100 nodes. The evolution is determined by 
the dynamics ([T]) and Q with parameters a = 2.0 and r = 
— i^q\qq ~ 10^. (a): Fraction F of synchronized pairs in the 
system, (b): Number of synchronization clusters, (c): Size of 
the largest three clusters. 



tion of their magnitudes. Each time step t contributes 
with its F^ value to the frequency. 

How is the fraction, F, of synchronized pairs in the net- 
work related to the synchronization structure in terms of 
cluster formation? We define a cluster as a set of units 
which are connected by synchronized couplings (single- 
link clustering). Fig. [s] (b) shows the number of clusters 
as a function of time. It corresponds to the time evolution 
of F displayed in Fig. |5](a). Most of the time the system 
is not synchronized and the number of clusters is of order 
of the size N of the network. But occasionally the units 
cooperate and generate a few clusters. This is also shown 
in Fig. [5] (c) where the size of the three largest clusters is 
plotted versus time. Sometimes, even the whole network 
becomes a single cluster with a common chaotic trajec- 
tory over several hundreds of time steps. In order to in- 
vestigate the distributions of the cluster sizes, extensive 
simulations on larger systems need to be conducted. 

The duration of the pulses is distributed over a broad 
range, as well. To supress the influence of the choice of 
the bin width. Fig. [6] shows its cumulative histograms. 
It can be inferred that longer Ft pulses appear less fre- 
quently than shorter ones. Of course, due to the finite 
recording time of 5 x 10^ time steps, the lower probability 
for events in the tails of the distributions leads to cut- 
offs in the latter. This cutoff shifts to larger durations 
for larger r. Furthermore, revisiting Fig. [4j there is a 
tendency towards more pulses for larger decay times r; 
curves corresponding to larger r lie above those corre- 
sponding to smaller r. However, this does no longer hold 
for r > 10^. This is because for r > 10^, pulses with 
F = 1 and a length of more than 1000 time steps are 




20 50 100 200 500 1000 2000 
Duration of F^ pulses 

FIG. 6. (Color online) Cumulative histograms of the dura- 
tions of global synchronization pulses for varying r and fixed 
a = 2.0. Every entry indicates the relative frequency of pulses 
with duration equal to or larger than the number of time steps 
shown on the horizontal axis. The bin width is five time steps. 
By definition, a global pulse starts, when the global synchro- 
nization exceeds the threshold Fc = 1%, and it ends after 
falling below the threshold. Notice the double logarithmic 
scale. 



observed. Since all distributions are recorded over time 
frames of equal size (5 x 10^ time steps), the appearance 
of very long pulses with F = 1 neccessarily results in a 
decrease in the number of time steps with F < 1 within 
the time frame. 

The distribution of the couplings is not critical. Fig. [7| 
shows a Gaussian-like distribution with a time dependent 
mean value which fluctuates around the critical value of 
the static homogeneous network. 

The activity of the network is rather irregular, but is 
it still chaotic? We calculated the difference between two 
nearby trajectories a and b in the space of the dynamic 
variables and coupling strengths, defined by 
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(7) 



A log-linear plot of Df^ clearly shows an exponential 
divergence (see Fig. [s] (a)) with a positive, but small 
Lyapunov exponent for all parameters r and a which we 
investigated (see Fig. [8](b)). Thus, the dynamics of the 
systems are still chaotic. 

For biological applications, the sensitivity of the net- 
works to external stimuli is of particular interest. We 
investigate the systems' responses to excitations of the 
following form. A stimulus is realized by, firstly, impos- 
ing the state 



^stim 



(8) 



to the first A^stim nodes i G {!,..., A^stim}, where Xstim 
and SXl^^^ are uniformly distributed random numbers 
with Xstim e [0, 0.99) and SX^^^^ G [O , IQ-^^). The 
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FIG. 7. (Color online) Distribution of coupling strengths e^^ 
for different time steps in Fig. [2] The fits indicated by the red 
solid lines are Gaussian curves with according mean and stan- 
dard deviation. The blue dashed lines are Gaussian curves, 
where the mean and standard deviation are obtained from 
averages over all couplings for 2 x 10^ time steps. 
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FIG. 8. (Color online) Evaluation of the largest Lyapunov 
exponent for complex systems with multiple variables. The 
trajectories in (a) show the divergence V^^ of a system a, with 
r = 10"^ and a = 2.0, and its cloned version b in which every 
variable is perturbed by a value of 10~^^. Once the distance 
exceeds a value of 10~^, the copy is reinitialized and t is reset 
to zero. Logarithmic fits of the data yield a distribution of 
Lyapunov exponents. The slope of the dashed line in (a) 
corresponds to the averaged Lyapunov exponent over all fits. 
It is the largest Lyapunov exponent (LLE) of the system. Fig. 
(b) shows the LLE for all investigated parameter sets (/i,cr). 



mutual synchronization of the A^stim nodes contributes 
to r with 

_ (^°r) _ iV.tim (iVstim - 1) 

In addition, their mutual couplings are set to the maxi- 
mum magnitude of one, 

e%^ = l V i,j^ie{l,...,Nstim}. (10) 

Thus, here a stimulus means that an almost completely 
synchronized state is imposed on the cluster of A^stim ex- 
cited nodes and the corresponding nodes are maximally 
coupled. Can a small fraction of synchronized units drive 
the whole network to complete synchronization before 
their mutual couplings have decayed below the synchro- 
nization threshold? Fig. [9] shows simulation results of 
a system with r = 10^ in which NsHm = 15 units and 



rstim ^ 2.12% of the couplings are stimulated at time 
steps 5,000, 10,000, and 15,000. Beside the naturally 
occurring synchronization pulses, every applied stimulus 
leads to a pulse in which the entire network becomes syn- 
chronized. If the number of stimulated units is smaller 
than a critical threshold, the network will not respond to 
the stimulus. The fraction of the network that needs to 
be stimulated to trigger pulses which extend to the whole 
system depends on the decay time, r of the couplings. 
The upper part of Fig. [9] shows the synchronization of 
one stimulated unit with its environment, while the lower 
14 lines correspond to the other stimulated units. We in- 
fer that even several thousand time steps after the excita- 
tions, there is an increased probability for the stimulated 
cluster to synchronize, i.e. the system memorizes the 
stimuli over the time scale r of the couplings. 



6 




t 



FIG. 9. (Color online) Simulations for a completely connected network of N=100 nodes. The evolution is determined by the 
dynamics ([T]) and ^ with parameters r = "h^^^ggg ~ ^ — 2-0. At time steps 5,000, 10,000, and 15,000, clusters of 

A^stim = 15 units, and thus Fstim = ^""^'ivliv-'io""^^ ^ 100% ^ 2.12% of the pairs, are stimulated in terms of both their states and 
their mutual couplings. The red pulses in the upper part indicate the local synchronization of one unit of the stimulated cluster 
with the remaining 99 units. Among them, the lower (A^stim — 1) lines indicate the synchronization with the other stimulated 
nodes. In the lower part, the blue lines display the trajectories of Ft, and the red dashed curves indicate the mean coupling 
strengths at time t, averaged over all pairs of units in the systems. 




FIG. 10. (Color online) Synchronization threshold Cc for a 
two-dimensional square lattice (p=0) with uniform coupling 
strengths, depending on the lateral system size L = VN. 



B. 2-d lattice with long-range interactions 

In addition to fully connected systems we also consid- 
ered two-dimensional square lattices with nearest neigh- 
bor couplings. To suppress finite-size effects the bound- 
aries are continued periodically. Square lattices with lat- 
eral size L and uniform coupling strengths are not able 
to entirely synchronize for L > 4 because their hypothet- 
ical [28 synchronization threshold, ec, is larger than one, 
as will be shown below. Numerical investigations indi- 
cate that this is neither possible for an adaptation of the 



couplings according to ([6|. Therefore, we add long-range 
couplings to the short-range interactions of the square 
lattice. By randomly introducing bidirectional links to 
the system with probability p, the hypothetical synchro- 
nization threshold, determined by the graph spectrum 
of the static network, decreases. Thus, for sufficiently 
large p, Cc falls below one and the networks with static 
uniformly weighted couplings can be synchronized (Fig. 
11]). 

We will investigate two-dimensional grids with addi- 
tional long-range links and adaptive coupling weights. 
Since the node degree /c* is no longer N — 1 for all vertices, 
dynamics ([T]) will be modified to 



E 



.1 A'^ 



with the adjacency matrix A [29^. In analogy to Bj), the 
criterion for the stability of a system with static uniform 
couplings, el^ = e, is given by 



1-71 



Cr <e< 



1-71 



(12) 



with 7i being the second largest eigenvalue of the cou- 
pling matrix G, which equals the adjacency matrix with 
the row sums normalized to unity: G^^ = 

For two-dimensional hypercubic grids of linear size 
L with uniform coupling strenghts (i.e. the coupling 
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FIG. 11. (Color online) Synchronization threshold Cc for a 
network generated from a two-dimensional grid, depending 
on the probability p of establishing additional connections for 
several system sizes N — . Every point is an average over 
five topologies with the same value of p. Cc can be calculated 
from the spectral properties of the coupling matrix (12). 




0.01 0.02 0.05 
P 



0.1 



0.2 



FIG. 12. (Color online) Double-logarithmic display of the 
critical coupling strengths of Fig. |11| The illustration is ex- 
tended to the theoretically calculated values with magnitude 
larger than one. 



strength between all pairs of neighboring units i and 
j is G^^ = I) and periodic boundary conditions, it is 
known that the eigenvalues of the Laplacian matrix 
L = 4 (1 — G) are given by 



A 



{mo,} 



4 sm -— h sm , I 



L 



L J 



(13) 



where {rria} is a 2-tuple with rria G {0, 1, . . . , L — 1} and 
L'^ = N (see [30 ). Since L and G have the same eigen- 
vectors, the relation between 7/^ and A^ is given by 



7fe = 1 



Afe 
4 ' 



(14) 



Consequently, the second largest jk corresponds to the 
second smallest Afc. The latter is given by 



Ai = A, 
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FIG. 13. (Color online) Fraction Ft of all pairs in the net- 
work, which are synchronized at time t. Simulations for a 
two-dimensional square lattice with additional long-range in- 
teractions with N — — 100 nodes. The evolution is 
determined by the dynamics (11) and (|6| with parameters 

^ = -h^oiggg ^ and a ' ' ' 
added with probability (a) 
p 0.4. 



2.0. Long-range couplings are 
0.08, (b) p = 0.15, and 



Hence, for a 2-dimensional grid equation (12) yields 



1 



sm 



2 TT 



< e < 



sm 



2 TT 



(16) 



Fig. 



TQ| shows the critical coupling strength 
For L 



ec, ver- 
> 4 it exceeds one 



sus the lateral system size L. 
and thus no complete synchronization is possible. While 
this result is derived from grids with uniform coupling 
strenghts, numerical simulations reveal that even for an 
adaptive variation of the couplings no complete synchro- 
nization can be achieved. 

The fact that complete synchronization is not possible 
for L > 4 seems to contradict the observation that larger 
systems with a certain fraction p of long-range interac- 
tions posses a tendency towards lower synchronization 
thresholds ec (Fig. 11). However, Fig. [12] shows an 
extended plot range of the numerically calculated syn- 
chronization thresholds, including hypothetical values of 
ec > 1. One finds that as p approaches zero, the curves 
intersect at some point and for p = those systems with 
larger lateral size exhibit a larger Cc 



Fig. 13 shows simulation results of the dynamics (11) 
for networks with r 10"^, cr 2.0, and N = L'^ = 100 
for various p. Up to p < 0.07 we do not observe syn- 
chronization between the units. With p > 0.08 {L = 10) 
the synchronization threshold of a static system, in Fig. 
11 drops below one which makes synchronization possi- 
ble. Above p > 0.08 we also find pulses of synchroniza- 
tion in the network with adaptive couplings. Both the 
duration and intensity of the F-spikes increase with p as 
the synchronization threshold of the corresponding static 
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network decreases (Fig. 13). For p = 0.4 the results in 



figure [13] (c) resemble those for a completely connected 
topology. According results were found for r = 10^. 

As for the completely connected systems, both the 
magnitude of F and the duration of the F pulses follow 
heavy-tailed distributions. 



IV. DISCUSSION 

We have investigated a coupled map lattice which 
shows chaos, synchronization, and criticality. These 
macroscopic properties are generated by dynamic cou- 
plings with competing adaptation rules. The network re- 
laxes to a chaotic state which exhibits pulses of chaos syn- 
chronization. Synchronized activity has been observed 
for all sizes as well as for all time scales with correspond- 
ing heavy-tailed distributions. An all-to-all coupled net- 
work possesses similar properties as a square lattice with 
additional long-range couplings. The network memorizes 
a stimulus for a long period if the size of stimulated units 
is large enough. 



Pulsed chaos synchronization has been shown by nu- 
merical simulations of coupled map lattices. However, 
we expect that synchronized pulses will be found in net- 
works of chaotic differential equations, as well; but this 
has to be shown. 

An interesting question is whether pulsed synchroniza- 
tion of an irregular dynamics is a relevant mechanism of 
biological neural networks. Synchronization is believed 
to be involved in the transmission and processing of in- 
formation in the cortex. Here we consider a homoge- 
nous network of nonlinear units with irregular dynamics. 
In the resting state, i.e. without stimulus and without 
learning, the units may communicate with each other by 
spontaneously creating clusters of all sizes. On top of the 
static topological network a dynamic network of synchro- 
nized clusters emerges. These clusters can be triggered 
by a small group of synchronized units. Hence, for bio- 
logical applications, one might extend this research in the 
direction of more realistic models, from integrate- and- fire 
to Hodgkin-Huxley models, consider different time scales 
for the synaptic plasticity compared to the neuronal dy- 
namics, and investigate the response to stimuli and the 
effect of learning in more detail. 
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